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ABSTRACT 


In  this  paper  we  consider  some  properties  of  a broad  clasa  of  network 
decomposition  switches.  Expression  are  given  for  the  semi -Markov  matrices 
of  the  output  Markov  renewal  processes  they  produce,  and  a classification 
theorem  for  the  states  In  these  processes. 
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1.  Introduction.  We  consider  an  arrival  stream  containing  a number  of 

different  customer  types,  with  J the  type  of  the  nth  arrival.  Customer  C 

n n 

arrives  at  time  T , with  0 - T < T,  <...  We  write  X - T - T ,,  with 
n o 1 n n n-1 

X - 0,  and  assume  that  J takes  values  in  some  countable  set  I.  The  switch 
o n 

is  defined  by  the  random  variable  Yq,  which  takes  one  of  a finite  number,  R, 
of  values,  depending  on  the  output  stream  to  which  the  nth  customer  is  assigned. 

In  Cherry  and  McNickle  [1}  a switch  {Y^}  was  defined  to  be  semi -Markov 
if 


p(Jn  " Yn“  r»  Xn  - c I Yn-l'“‘Yo‘ 


*<•>„-  3.  V r,  Xn  < t | Vl> • » i 1- 


The  class  of  stationary  semi-Markov  switches  was  defined  to  be  those 
semi-Markov  switches  with  the  additional  property  that 


P(J  ■ j,  X £ t | J i,«..J  , Y i • . • «Y  , X . ,...X. ) 
n n — n-i  o n— 1 o n— 1 l 


P(J  ■ j,  X < t I J .),  for  n > 
n J n - 1 n-1  — 


1. 


2.  Necessary  Conditions  for  Semi-Markov  Output  Streams.  In  Cherry  and  McNickle 
[1]  it  was  shown  that  the  condition  for  a semi-Mark ov  switch  was  sufficient 
to  ensure  that  each  of  the  output  streams  formed  a Markov  renewal  process. 

We  may  ask  if  such  a condition  is  necessary. 

Although  all  of  the  published  examples  of  switches  are  semi-Markov  it  turns 
out  that  the  condition  is  not  necessary,  as  the  following  example  shows. 

Consider  a renewal  process  with  distribution  function  F(t),  which  forms  the 
input  to  a switch  producing  three  output  streams.  Customers  are  assigned 
deterministically  in  the  order  . . .1,2, 3, 2, 1,2,3.  ...  Now 


1 


2 


P(Y  - 3,  X < t 
n n 


Vl"  2*  V2*-V 


!'<*>•  V2'1* 


and  so  che  switch  Is  not  semi -Markov,  yec  clearly  screams  1 and  3 are  renewal 

4 

processes  with  common  distribution  function  F (t) , and  stream  2 is  a renewal 
process  with  distribution  function  F2(t).  Here  Fn(t)  stands  for  the  n-fold 
convolution  of  F(t).  We  'have  the.,  following result,  however,  at  least 
when  the  input  process  has  non- lattice  distributions. 


THEOREM  1 Any  stationary  switch  which  acts  on  a Markov  renewal 
process  to  produce  output  streams  which  are  Markov  renewal  processes  defined 
on  the  same  state  space  has  a representation  as  a semi-Markov  switch. 


PROOF.  Consider  the  sequence  of  events: 

J»-R*  Yn-R»  Xn-R Jn*  Yn"  r*  XnJ  for  *°mm  r E {1*2 

Either:  (1)  At  least  one  of  the  arrivals  C -,...,  C .(say  C„),  was  also 

n-1  n-R’  * 

assigned  to  the  r-th  output  stream,  so  that  with  probability  one 


P(Jn“  J*  V r’  Xn-t  I Jn-1’  Yn-1’  Xn-1*  **•»  Vr*  Vl*  Xn-E****'-Yc 


P(Jn"  3*  Yn“  r*  Xn  -*  I Jn-1’  Vl*  Xn-1 Yf"  r)* 


since  the  r-th  output  stream  is  a renewal  process; 


Or:  (11)  At  least  two  of  the  arrivals  C ......  C D (say  C and  C ), 

n— l n— a p q 

were  assigned  to  the  same  output  stream,  and  hence  for  some  s e {1,2,...,R}: 


P<V  1-  V '•  x«  - 1 I Vi"  Vl" 


Y - S. 


*YP"  ■»••••  Xn-] 


R* 


V 


P(Jn“  J*  Yn"  r’  Xn  - * I Vl*  Vl*  Xn-1 Yp"  * 


Mow 


n"  3*  Y " r 
P(J  - J I J 


n *V* 


Vl*  Vl"  *•  X, 


-n  3 
*(Y - r,  X 


’n-1’  Vl"**  Vl’ 


n-1*  Jn-R*  Yn-I) 

Vw*  Y^)  • 


3 

and  since  both  {J  , X } and  the  s th  output  stream  are  Markov  renewal 
n n 

processes,  the  event  {J«j,Y«r,X<t}  must  be  conditionally 

n n n— 

independent  of  xn_^»  xn  2*  ••• 

flo  since  by  total  probability  the  switch  is  Independent  of  (J^_^,Yn_R) , the 
switch  must  be  equivalent  to  one  in  which  Xq)  forms 

a Markov  renewal  process.  Hence  it  has  a representation  as  a semi-Markov  switch. 

Thus  for  example  the  three  state  switch  mentioned  previously  can  be  considered 
a semi-Markov  switch  with  an  imbedded  Markov  chain  of  order  two. 

A useful  case  of  the  theorem  is  when  R - 2,  i trying  the  following mru  Ly.- 
corollary. 

COROLLARY ; A stationary  switch  which  acts  on  a Markov  renewal 
process  to  produce  two  output  streams  which  are  Markov  renewal  processes  defined 
on  the  same  state  space  must  be  semi-Markov. 

3.  The  Output  Streams 

We  assume  for  convenience  that  {J  ,Y  , X } is  an  irreducible 

n’  n n 

Markov  renewal  process  and  that  the  initial  arrival  was  assigned  to  the 
r-th  output  stream.  Events  in  the  filter  set  K * I x {r}  of  the  state 
space  of  the  Markov  renewal  process  forms  the  r-th  output  stream. 

In  particular,  let  nQ  = 0, 

nk+1*  inf  ( i > (J^)  e K) , k = 0,1,2,..., 

and  define  the  process  {Z^t^}  by: 

Z = J , t=  T,  for  k = 0,1,2,... 

k nk  k “k 

We  have  shown  previously  that  is  a Markov  renewal  process  which 

describes  the  behaviour  of  the  r-th  output  stream. 

Let  G(t)  = <Gi(J(t)}  - {p(zk+1“  Wk+1  - t I Z^- 
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where  W = t.  - t . A formal  expression  for  the  semi-Markov  matrix 
kr.1  k+1  k 

of  the  r-th  output  stream,  G(t),  may  be  found  fran  Cinlar  |3J 


We  write  the  semi-Markov  matrix  of  the  {J  ,Y  , X } process  in 

n n n 

block  form  as  A = { A } , where  the  i.J-th  element  of  the  m x m matrix 

PQ 

V°  ia  P(Jn"  J’  V i 1 I Vl*  *•  Vi'  Th“  on 

relabelling  the  output  streams  if  necessary,  A may  be  partitioned  as 


r 

Cinlar's  analysis  then  shows  that  G(t)  then  satisfies: 

G(t)  = A (t)  + B « (I  D°)  * C(t) , 

rr  n 

where  * stands  for  the  usual  matrix  convolution  operation  apd  Dn  for  the 
n-fold  convolution  of  D with  itself. 

If  the  first  arrival  was  assigned  to  the  s-th  output  stream,  where 
s ? r,  then  partitioning  A as: 

A [A  B?] 

A = I sr  , 

IP’  Dl 

leads  to  a similar  expression  for  the  matrix  of  transition  functions  for  the 
time  until  the  first  event  in  the  r-th  output  stream. 

It  appears,  however,  that  no  simplification  of  these  expressions  can 
be  made  unless  the  class  of  switches  is  restricted  further. 


Switches  depending  only  on  the  input  Markov  renewal  process. 

Consider  the  class  of  stationary  semi -Markov  switches  in  which  the 
switch  no  longer  depends  explicitly  on  the  assignment  of  the  last  customer. 

Thu.  ?<V  r- 1 Jn,  Xn.  Vj.  * m„.  r | Jn.  Xn,  tor  n • 1,2,. 
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The  semi-Markov  matrices  for  the  output  streams  of  a special  case  of 
this  class  where  arrivals  are  assigned  according  to  type  alone  were  derived 
directly  in  Cinlar  {2]  . By  considering  a suitable  Markov  renewal 

equation  expressions  for  those  of  all  switches  of  this  class  can  be  found. 
Since  the  switch  is  stationary,  for  any  s e {l,2,...,R} 

P(Jn.  J,  Y„-  r,  t | i,  Vi=  «>  ’ 

= j ( t ) qr(i,j,t), 

where  F(t)  = { f . ( t ) } is  the  semi-Markov  matrix  of  the  arrival  process,  and 
1 J 


CL^ij  ,t) 


P(V  r I V J-  V4*  Jn-1-  l!- 


Let  G(t)  = { G . ( t ) } be  the  semi-Markov  matrix  for  the  r-th  output  stream. 
J 

Then  since  the  condition  on  the  switch  implies  that  all  the  higher  order 

transition  probabilities  of  the  {J  ,Y  , X } process  are  independent  of  the 

n n n 

initial  state  of  the  switch 


Gu(t) 


i r j-  vi-  vv'v i5 


l=\  k+1 


m R t 


fUr<«  * l j,  J,  l f ‘V  hlV'*  5'V‘f(X'X‘dX)  ' V1' 

p <v.* vi  v1  • V h'V 


1=2  h=l  s= 1 o "k*  'k 
s^r 


s) 


k+1 


» m t 

* fiir(t)  ♦ l l I (fihW*)  - fihr(dx))- 


p w„,  i.  Vr  V 1 ' *->•  \;t  V11  (t'x)  1 V1' h)’ 


k+1 
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Hence 

* X /t(f1h<d5‘>  - fihr(d*»  V4'*’’ 

for  all  i,j  t I,  (l) 

If  the  first  arrival  to  the  switch  wus  not  assigned  to  the  r-th 
output  stream  then  it  can  be  seen  that  the  conditions  on  this  class  of  switch 
mean  that  the  distributions  of  the  delay  until  the  first  event  in  the  r-th 
output  stream  also  satisfy  the  equations  (l).  These  equations  can  be  solved 
under  a further  weak  assumption  to  give: 

Theorem  3 

If  all  the  states  of  the  input  Markov  renewal  process  are 
conservative  then  the  r-th  output  stream  from  the  switch  forms  a Markov  renewal 
process  with  semi-Markov  matrix  and  matrix-valued  distribution  function  of  the 
time  until  the  first  event  both  given  by 

t 

G(t)  - / R (dx)  F (t-x)  , (2) 

0 r r 

where  F^(t)  = (f^r(t)},  and  R^Ct)  is  the  Markov  renewal  matrix 
corresponding  to  the  semi-Markov  matrix  {f^Ct)  - fj.  (t)}. 

Proof : Ff(t)  and  {f  (t)  - fj^Ct)}  are  both  semi-Markov  matrices,  so 

(1)  is  a Markov  renewal  equation.  If  all  states  in  I are  conservative 
then  Cinlar  [3]  _ shows  that  a unique  solution  to  equations  of  this  type 
exists,  and  in  this  case  is  given  by  (2). 

If  I is  finite,  then  at  least  for  Re(s)  > 0 

m 

G(s)  - l (F(s)  - F <s))n  F (s), 
n-0  ^ 
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- (I  - F(s)  + ^.(s))"1  F^s),  (3) 

where  F (s)  = /"e"stF  (dt) , G(s)  - /”e_StG(dt). 
i or  — o 


We  can  further  note  that  if  f^r(t)  **  f ± (t)  . qf  (j) , so  that  the 
switch  depends  on  the  type  of  the  arrival  only,  then  with  Q = {6^q^(j)} 


G(s)  - (I  - F(s)  + F(s).Q)'iF(s).Q, 
F(s)(I  - (I-Q)F(8))"*Q  , 


which  was  Cinlar's  196^1  result. 

One  example  of  the  application  of  (3)  is  to  a generalization  of  Palm's 
overflow  problem  to  the  SM/M/l/l  queue.  Customers  arrive  according  to  a 
Markov  renewal  process  at  a negative  exponential  server  with  mean  service 
time  p.  If  there  is  no  waiting  room  then  the  stream  of  customers  who  join 
the  queue  and  those  who  overflow  can  be  considered  aB  the  results  of  a 
semi-Markov  switch  of  this  type.  For  the  overflow  stream  F^s)  - F(s+p), 
and  so 

G(s)  - (I  - F(s)  + F(s+U))  F(s+y) 


is  the  semi-Markov  matrix  of  the  ovetelow  stream.  The  renewal  case  of  this 
result  is  well  known  e.g.  see  Khinchine  [4] 


4.  Classification  of  states  in  the  output  streams.  Although  states  which 
are  transient  in  the  arrival  process  will  clearly  also  be  transient  in  any 
output  stream,  the  same  is  not  true  for  recurrent  states. 

Let  fljr.  ■ P(V  >■  V ■ 1 Vl‘  U Vl'  r)>  "lth  G - <81J>  the 

imbedded  Markov  chain  for  the  rth  output  stream.  We  write  (j,r)  for  the  state 

(J  - j,  Y-  r). 
n n 
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The  following  result  completes  the  characterization  of  the  output  streams 
of  a semi-Markov  switch. 

THEOREM  4 For  a stationary  semi-Markov  switch  state  j in  the  r-th 
output  stream  will  be  recurrent  if  and  only  if  there  exists  some  recurrent 
state  k in  the  arrival  process  such  that  j— >k  and  if  (j ,r)  — -*(k,s)  for  any  s 
then  (k,s) — >(j,r). 

00  oo 

PROOF  Clearly  l g*  - l . 

p-1  33  £-1  33 


Let  R*  - {s|(j,r) — >(k,s) },  with  N(s)  - min  (nlf£j8r  > °) » N * (N(s)), 

R 

and  6 - min  (fff8^). 

r'  kjsr 


l 

p-1 


oo 


> l 

A-N 


l f fJ:N(8)  f"<8> 

k-l  8-1  jkr8  kJSr  ’ 


00 


1 l 


A-N 


r -A~N(s)  N(b) 
jkrs  kjrs 


> <5 


l 


A-N 


y fA-N(s) 
jkrs  » 


« 6 


V T 

L L ivrs  > 
A-N  s-1  3 


which  is  divergent,  since  k is  recurrent  and  j — ^k. 

Necessity  of  the  first  condition  follows  since  if  (j,r)  is  recurrent  then 

at  least  one  of  the  terms  f f^8^  must  be  positive,  and  hence  the 

jkrs  kjsr  r ’ 

recurrent  state  k existB.  The  second  condition  is  a standard  result  for  recurrent 
states. 

00 

If  the  switch  is  of  the  type  described  in  section  4 then  since  £ g^ 

D"X  ■ 

°°  m £,-1  P 
- I £ f , f,  , where  f,  - f,  (°°) , the  conditions  of  the  theorem  may 
£^2^  k"l  J ^ 


be  simplified. 
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COROLLARY : For  a semi-Markov  switch  in  which  the  assignment  of  an 

arrival  is  independent  of  the  previous  assignment,  state  j in  the  rth  output 
stream  is  recurrent  if  and  only  if  there  exists  some  recurrent  state  k in  the 


arrival  process  such  that  k — and  f r > 0. 


The  proof  of  this  is  similar  to  that  of  the  theorem  and  is  ommitted. 
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